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Abstract 

In this paper, we derive information-theoretic performance hmits for three classes of two-user 
state-dependent discrete memoryless broadcast channels, with noncausal side-information at the 
encoder. The first class of channels comprises a sender broadcasting two independent messages to 
two non-cooperating receivers; for channels of the second class, each receiver is given the message 
it need not decode; and the third class comprises channels where the sender is constrained to 
keep each message confidential from the unintended receiver. We derive inner bounds for all the 
three classes of channels. For the first and second class of channels, we discuss the rate penalty 
on the achievable region for having to deal with side-information. For channels of third class, 
we characterize the rate penalties for having to deal not only with side-information, but also to 
satisfy confidentiality constraints. We then derive outer bounds, where we present an explicit 
characterization of sum-rate bounds for the first and third class of channels. For channels of the 
second class, we show that our outer bounds are within a fixed gap away from the achievable rate 
region, where the gap is independent of the distribution characterizing this class of channels. The 
channel models presented in this paper are useful variants of the classical broadcast channel, and 
provide fundamental building blocks for cellular downlink communications with side- information, 
such as fading in the wireless medium, interference caused by neighboring nodes in the network, 
etc. at the encoder; two-way relay communications; and secure wireless broadcasting. 

Keywords: State-dependent broadcast channels, side-information, rate regions, outer bounds. 

1 Introduction 

The information-theoretic study of broadcast channels (BC) was initiated first by Cover in [Ij. In 

the classical setting, the BC comprises a sender who wishes to transmit k independent messages to 
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k noncooperative receivers. The largest known inner bound on the capacity region when k = 2 was 
derived by Marton pj. Recently, some ideas were discussed in |3j, that is conjectured to lead to a 
larger inner bound. Capacity outer bounds were presented by Sato in [4J by utilizing the fact that 
the capacity region of BC depends on the marginal transition probabilities. Nair and El Gamal 
provided outer bounds for the two-user case [5], based on the results of the more capable BC [6]. 
Liang et. al generalized the outer bounds of [5j by deriving the New-Jersey outer bound. Some 
properties of the New-Jersey outer bound were exposed in [7], where it was shown to be equivalent 
to the computable UVW-bound with bounded cardinalities of the auxiliary random variables. 

Several variants of this classical setting have also received considerable attention. One of the 
most prominent variants is the state-dependent BC with side-information, where the probability 
distribution characterizing the channel depends on a state process, and with the channel state made 
available as side-information at the transmitter, or at the receiver, or at both ends. Capacity inner 
bounds for the two-user BC with noncausal side-information at the transmitter were derived in [8], 
where Marton's achievability scheme was extended to state-dependent channels. In [9|, inner and 
outer bounds were derived for the degraded BC with noncausal side-information at the transmitter; 
the capacity region was derived when side-information was obtained to the encoder in a causal 
manner. The capacity region for BC with receiver side-information was derived in jTUj, where a 
genie provides each receiver with the message it need not decode. To the best of the authors' 
knowledge, outer bounds for the two-user BC with noncausal side-information at the encoder have 
not appeared in the literature. 

Yet another issue in wireless communications, owing to the broadcast nature of the wireless 
medium, is related to information security. That is, the broadcast nature of wireless networks 
facilitates malicious or unauthorized access to confidential data, denial of service attacks, corruption 
of sensitive data, etc. An information-theoretic approach to address problems related to security 
has gained rapid momentum, and is commonly referred to as information-theoretic confidentiality 
or wireless physical-layer security p^lj. An information-theoretic approach to secure broadcasting 
was inspired by the pioneering work of Csiszar and Korner [12j, who derived capacity bounds for the 
two-user BC, when the sender transmits a private message to receiver 1 and a common message to 
both receivers, while keeping the private message confidential from receiver 2. Secure broadcasting 
with a single transmitter and multiple receivers in the presence of an external eavesdropper was 
considered in |13j . where the secrecy capacity region was obtained for several special classes of 
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channels. In [T5], capacity bounds were derived for BC where a sender broadcasts two independent 
messages to two receivers, while keeping each message confidential from the unintended receiver. 
Capacity results and bounds for Gaussian BC with confidential messages were reported in [15] - |17) . 
The reader is referred to [18] for a comprehensive review of physical-layer security in BC. However, 
to the best of the authors' knowledge, the joint problem of side-information and confidentiality on 
the BC has not been addressed in the literature. 

1.1 Main contributions 

In this paper, we aim to provide useful insights into the effect of noncausal side-information at the 
encoder on (1) the classical two-user BC; (2) the BC with genie- aided receiver side-information; 
and (3) the BC with confidentiality constraints on the messages. Towards this end, we define three 
different classes of two- user discrete memoryless BC with noncausal side-information at the encoder. 
Of particular interest is the Class III channels (described below), which provides a fundamental 
building block to jointly address side-information and confidentiality in BC. 

1. Class I: A sender broadcasts two independent messages to two non-cooperating receivers 
(see Fig. [l]^a)). We derive an inner bound for this class of channels and characterize the 
rate penalty for dealing with noncausal side-information at the encoder. We are mainly 
concerned with outer bounds for this class of channels, where we present an explicit single- 
letter characterization of the sum-rate bound, along with bounds on single-user rates. An 
example for Class I channels is a base-station transmitting to two mobile receivers, with the 
base-station having prior knowledge of interference from a transmitter located in its vicinity, 
e.g., through a backhaul network. 

2. Class II: A sender broadcasts two independent messages to two receivers, with each receiver 
having a priori knowledge of the message it need not decode (see Fig. [l]^b)). An example of 
this scenario is full-duplex communications between two nodes, aided by a relay. The relay 
node broadcasts the messages to the terminals, with each terminal knowing its own message. 
We devise an achievability scheme to derive an inner bound for this class of channels and show 
that the achievable rate for each user is in fact the maximum rate achievable for a single-user 
channel with states known a priori at the encoder. We also derive an outer bound which 
is within a fixed gap away from the achievable region, where the gap is independent of the 
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distribution characterizing this class of channels. 

3. Class III: A sender broadcasts two independent messages to two receivers, such that each 
message is kept confidential from the unintended receiver (see Fig. [l](c)). To the best of 
the authors' knowledge, this is the first instance of a study of simultaneous impact of side- 
information and confidentiality constraints on BC. An inner bound for this class of channels 
is derived employing stochastic encoders to satisfy confidentiality constraints; we character- 
ize the rate penalties for having to deal not only with side-information, but also to satisfy 
confidentiality constraints. One of the outer bounds is derived by employing a genie, which 
gives one of the receivers the message it need not decode, while the other receiver computes 
the equivocation rate treating this message as side-information. We also derive another outer 
bound, with an explicit characterization of the sum-rate bounds. As an example for this class 
of channels, we can extend the example considered for Class I channels, with the additional 
constraint of keeping each message confidential from the unintended receiver. 

The remainder of the paper is organized as follows. In Section [2j we introduce the notation used 
and provide a mathematical model for the discrete memoryless version of the channels considered in 
this paper. In Section |3j we summarize the main results of this paper by describing inner and outer 
bounds for all the channel models, and provide related discussion. The proofs of the achievability 
theorems can be found in Section |4j while the proofs of the outer bounds are provided in Section [5| 
Finally, we conclude the paper in Section [6j The encoder error analysis is relegated to Appendix |A| 

2 System model and notation 

The channels belonging to Class I, Class II and Class III are denoted Ci, C2 and C3, respectively. 
Calligraphic letters are used to denote finite sets, with a probability function defined on them. N 
is the number of channel uses, and n = 1,...,N denotes the channel index. Uppercase letters 
denote random variables (RV), while boldface uppercase letters denote a sequence of RVs. The 
following notation for a sequence of RVs is useful: = ( Vi,i, . . . , Yi^^); Y^~^ = ( . . . , Vi^n-i); 
and Yj^j.^_|_^ = ( Vi^n+i, . . . , Vi^n)- Lowercase letters are used to denote particular realizations of 
RVs, and boldface lowercase letters denote vectors. The sender is denoted S and the receivers are 
denoted Dt, where t = 1, 2 is the receiver index. Discrete RV X & X and Yt £ yt denote the channel 
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input and outputs, respectively. The encoder of S is supplied with side-information W G W , in a 
noncausal manner. The channel is assumed to be memoryless and is characterized by the conditional 
distribution p(Yi, Y2IX, W) = nn=iP(^i,ru V2,n|-^in l^n)- For sake of brevity, in the remainder of 
this paper, we use p{x) to denote p{X = x). Unless otherwise stated, p(x) = nn=iP(-'^n)- 

To transmit its messages, S generates two RVs Mt G Ait, where Ait = {1, • • . , 2^^'} denotes a 
set of message indices. Without loss of generality, 2^^^* is assumed to be an integer, with Rt being 
the transmission rate intended to D^. Mt denotes the message S intends to transmit to Dj, and is 
assumed to be independently generated and uniformly distributed over the finite set Ait- Integer 
mt £ Ait is a particular realization of Mt and denotes the message- index. 

Given the conditional distribution characterizing the channel, a {{2^^'^ ,2^^^),l>i, Pe^^) code 
for the channels Ci and C2 comprises N encoding functions /, such that X = f(mi,m2,W); for 
the channel C3, it comprises a stochastic encoder, which is defined by the matrix of conditional 
probabilities (/>(X|mi, m2, W), such that X]x'^(^l'"i' "^2, W) = 1. Here, 4>{X\mi, 012, W) denotes the 
probability that a pair of message-indices (mi, 012) is encoded as X G to be transmitted by S, 
in the presence of noncausal side-information W. For all channel models, there are two decoders 
gt : yf ^ Ait. 

The average probability of decoding error for the code, averaged over all codes, is Pi^^ = 
max{P^^^\p^f}, where, P^f = J2rm,m2 Ewgw^ 2N[fli+fl2l P^ [dtiyt^) / mt\mi, ^2, W], A rate 
pair (i?i,i?2) is said to be achievable for the channel Cc;c = 1,2,3, if there exists a sequence 
of ((2N-^i,2^^2),N,Pi'^^) codes, such that Ve > and sufficiently smah, p]^^ < e as N ^ 00. 
Furthermore, for the channel C3, the following constraints |19j on the conditional entropy must be 
satisfied for (Pi,P2) to be considered achievable: 

NPi -F(/Wi|Y2) < Ne, (1) 
NP2 - i^(M2|Yi) < Ne. (2) 

The capacity region is defined as the closure of the set of all achievable rate pairs (Pi, P2). 

3 Main results 

In this section, we state the achievability and converse theorems for all the channel models considered 
in this paper, and provide related discussion. Let Cc denote the capacity region of the channel Cc; 
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c = 1, 2, 3. We use the following auxiliary RVs defined on finite sets: U Vi E Vi and V2 £ V2- 



3.1 Class I channels 

For the channel Ci, we consider the set Vi of all joint probability distributions that can be 
factored as p{w)p{vi, V2\w)p{x\w, vi, V2)p{yi, y2\x)- For a given pi{.) G "Pi, a lower bound on the 
capacity region for Ci is described by the set 7^i,in(pi), which is defined as the union over all 
distributions pi{.) of the convex hull of the set of all rate pairs (i?i,i?2) that simultaneously satisfy 
(§-(§. 

Ri < I{Vi;Yi)-I{Vi;W), (3) 
R2 < I{V2;Y2)-I{V2;W), (4) 
R1 + R2 < I{Vi;Yi)+I{V2;Y2)-I{Vr,V2)-I{Vi,V2;W), (5) 

where Vi and V2 are constrained to satisfy the Markov chain (Vi, V2) — s- {X, W) — t- (Vi, Y2). 

Theorem 3.1 Let 7^l,^„ = Upi(.)6Pi Then, Uisn Q Ci. 



For proof, see Section [4. 1[ 

For a given pi{-) G "Pi, an outer bound for Ci is described by the set 7^i,out(pi)5 which is defined 
as the union of all rate pairs (i?i,i?2) that simultaneously satisfy ([S]) - ([7]). 

Ri < I{Vi;Yi)-I{Vi-W), (6) 
R2 < I{V2;Y2)-I{V2;W),, (7) 

where (V^ V2) ^ (X, 1/1/) ^ (Vi, Y2). 

Theorem 3.2 Let 7^l,o«^ = Upi(.)ePi T^i,out{pi)- Then, Ci C TZi^out- 



The proof of Theorem |3 . 2| can be found in Section 5.1 However, this outer bound does not include a 



bound on the sum-rates. To explicitly bound the sum-rate, we provide the following alternative outer 
bound for the channel Ci. We consider the set Vi of all joint probability distributions pK-) that 
can be factorized as follows: p{'w)p{u,vi,V2\w)p{x\'w,u,vi,V2)p{yi,y2\x). For a given G "Pj*, an 
outer bound for Ci is described by the set out(l'i)' which is defined as the union of all rate pairs 
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(i?i,i?2) that simultaneously satisfy Q - (11). 



Ri < I{U,Vi;Yi)-IiVr,W\U), 

R2 < I{U,V2;Y2)-I{V2;W\U), 

R1+R2 < I{U,Vi;Yi)-I{Vr,W\U) + I{U,V2;Y2\Vi) 

R1+R2 < IiU,V2;Y2)-I{V2;W\U) + I{U,Vi;Yi\V2) 

where the following Markov chain is satisfied: {U, Vi, V2) — )• (X, W) 

Theorem 3.3 Let 7^^^„„, = Upj(.)ePr T^louM)- Then, Ci C 7^* 



IiV2;W\U,V,) 
I{Vr,W\U,V2) 

(n,V2). 



(9) 
(10) 
(11) 



Section 5.2 contains the proof of Theorem 3.3 



3.2 Class II channels 

For the channel C2, we consider the set V2 of all joint probability distributions P2{-) of the form 
p{w)p{u\w)p{x\w , u)p(yi, y2\x). For a given P2i-) G V2, a lower bound on the capacity region for 
C2 is described by the set 7^2,111(^2)1 which is defined as the union over all distributions P2{-) of the 



convex-hull of the set of all rate pairs (i?i,i?2) that simultaneously satisfy (12) - (13). 

Ri < I{U;Yi)-I{U;W), (12) 
R2 < I{U;Y2)-I{U;W), (13) 

where the Markov chain U — ^ (X, W) — ^ (Vi, Y2) holds. 

Theorem 3.4 Let 7^2,m = Up2(.)eP2 '^2,m(P2)- Then, 7^2,™ ^ C2. 



The proof of Theorem 3.4 is relegated to Section 4.2 



For a given P2{-) G ^2, an outer bound for C2 is described by the set 7^2,out(P2)) which is defined 



as the union of all rate pairs (i?i,i?2) that simultaneously satisfy (14) - (15) 

Ri < I{U;Yi)-I{U;W) + H{U), 
R2 < L{U;Y2)-I{U;W) + H{U), 

with U (X, W) (n, Y2). 

Theorem 3.5 Let 7^2,o«t = Up2(.)eP2 '^2,o«t(P2)- Then, C2 C TZ2,out- 



(14) 
(15) 



The proof of Theorem 3.5 can be found in Section 5.3 



3.3 Class III channels 



For the channel C3, we consider the set of all joint probability distributions P3(.) that can be 
written as p{w)p{u)p{vi, V2\w, u)p{x\w, vi, i/2)p(yi> y2|^)- For a given pz{.) G "Ps, an inner bound on 
the capacity region for C3 is described by the set 7^3,111(^3); which is defined as the union over all 
distributions pz{.) of the convex- hull of the set of all rate pairs -R2) that simultaneously satisfy 



(16) - (18). 



Ri < IiVi;Yi\U)-max[IiVi;Y2\U,V2),IiVi;W\U)], 
R2 < I{V2;Y2\U)-max[I{V2;Yi\U,Vi),I{V2;W\U)], 
R1+R2 < I{Vr,Yi\U)+I{V2;Y2\U)-I{Vi;Y2\U,V2)-I{V2;Yi\U,Vi] 
-I{Vi-V2\U)-I{Vi,V2;W\U), 

where the following Markov chain is satisfied: U ^ {Vi, 1/2) — )■ (X, W) — )• (Vi, V2). 

Theorem 3.6 Let 7^3,m = Up3{.)G7'3 T^sMps)- Then, 7^3,^ C C3. 



(16) 
(17) 

(18) 



Section 4.3 contains the proof of Theorem 3.6 



For a given psi-) G V3, an outer bound for C3 is described by the set '7^3,out(P3)) which is defined 



as the union of all rate pairs {Ri,R2) that simultaneously satisfy (19) - (20) 



Ri < min[/i,/i*] 
R2 < min[/2,/2l 



(19) 
(20) 



where Ii, . . . , I2 are given by (21 ) - (24), respectively. 



h = I{Vi;Yi\U)-I{Vi;Y2\U) + HiW\U,V{ 



h 



I{ V2;Y2\U)- I{ V2;Yi\U) + Hi W\ U, V2, 



II ^ I{Vi-Yi\U,V2)-IiV,;Y2\U,V2)+H{W\U,Vi,V2), 
1*2 = I{V2;Y2\U,Vi)-I{V2;Yi\U,Vi)+H{W\U,Vi,V2), 



(21) 
(22) 
(23) 
(24) 



where L/ ( Vi, 1/2) (X, W) (Vi, Y2). The expressions ([23]) - ([24]) are obtained by letting a 
genie give Di message M2, while D2 computes the equivocation using M2 as side-information. 



Theorem 3.7 Let TZ^^out = Up3{.)G7'3 T^?.,out{vz) ■ Then, C3 C TZ^^out- 



The proof of Theorem |3.7| can be found in Section 5.4 We also provide the following outer bound 
for the channel C3, which explicitly characterizes the sum-rates. Consider the set P| of all joint 
probability distributions p'^{-) that can be factorized as follows: p{w)p{u, vi, V2\w)p{x\w , u, vi, V2) 
Piyi,y2\x). For a given p*^{.) G V^, an outer bound for C3 is described by the set T^soutiPs)^ which 



is defined as the union of all rate pairs {Ri,R2) that simultaneously satisfy (25) - (28) 



Ri < I{U,Vi;Yi)-I{Vi;W\U)-IiVi;Y2), (25) 

R2 < I{U,V2;Y2)-I{V2;W\U)-I{V2;Yi), (26) 
R1 + R2 < I{U,Vr,Yi)-I{Vr,W\U) + I{U,V2;Y2\Vi) 

-I{V2;W\U,Vi)-I{Vi-Y2), (27) 
R1 + R2 < IiU,V2;Y2)- I{V2;W\U) + I{U,Vi-Yi\V2) 

-I{Vr,W\U,V2)-I{V2;Yi), (28) 

where (U, Vi, V2) ^ (X, 1/1/) ^ (Vi, Y2). 

Theorem 3.8 Let 7^^^„„, = Up*(.)eP| n,ouM)- ^^e^' ^3 ^ n,ouf 



The proof of Theorem 3.8 can be found in Section 5.5 



3.4 Discussion 

A pictorial representation of the rate region for the channel Ci is shown in Fig. [2j When R2 = 0, 
the channel resembles a single-user channel (S,Di) with side-information (the Gel'fand-Pinsker's 
(GP) channel [20]) and S can transmit at the maximum achievable Ri given by ([3]), denoted by 
point the H. At the point H, the maximum achievable R2 is given by the point Ei = I{V2; Y2) — 
I{Vi; V2) — I{W; V2); this is obtained by treating the channel (S,D2) as a single-user channel with 
side-information. Therefore, the rectangle OHGEi is achievable. By exchanging Ri and R2 and 
following similar arguments the points E, given by (Q, and Fi = /( Vi; Vi) — /( Ui; V2\U) — I{W; Vi) 
are achievable. Hence, the rectangle OEFFi is also achievable. Since the points F and G are shown 
to be achievable, any point which lies on the line FG can also be achieved by deriving a bound on the 
binning rates (see (65) - (67), Appendix [A|) . This leads to a sum rate bound given by Finally, 



owing to convexity of the rate region, any point in the interior of the line FG is also achievable. 
Therefore, an achievable rate region for Ci is described by the pentagon OEFGH. 
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In the absence of side-information, i.e., W = {(j)}, the channel reduces to the classical two-user 
BC whose rate region is described by the convex-hull of the set of all rate pairs i22) that satisfy 
the following inequalities: 

Ri < I{Vi;Yi), (29) 
R2 < I{V2;Y2), (30) 
R1 + R2 < I{Vi-Yi) + I{V2;Y2)-I{Vi;V2). (31) 



For channels of Class II, each bound in (12) - (13) is the capacity of CP's single-user channel 
with noncausal side-information. In the absence of side-information, i.e., W = {</>}, we get Rt < 
I{U;Yt) = I{X;Yt), which represents the capacity region of BC when each receiver is given the 



message it need not decode [TO]. Furthermore, the outer bounds (14) - (15) is within a fixed gap, 
H{U), from the achievable region, where H{U) is independent of the distribution characterizing 
this class of channels. 

For Class III channels, the terms /(Vi; Y2\U, V2) and /(V2; Yi\U, Vi) quantify the rate-penalty 
for having to deal with confidentiality constraints on the messages, while the terms I{Vi; W\ U) and 
7(1/2; 1^1 ty) quantify the rate-penalty for having to deal with side-information. 

Using a combination of results from CP's channel and wiretap channels with side-information 
|21j . we obtain a pictorial representation of the rate region for the channel C3 as shown in Fig. [sj 
The arguments used to obtain this schematic are similar to those used for the channel Ci; there- 
fore, we briefly explain the construction of Fig. [3j The point Ai corresponds to the maximum 
achievable -Ri (when R2 = 0) and is given by ( |16[ ). Exchanging Ri and R2 we get the point Ci 
given by ([l7j). The points Bi = I{V2; Y2\U) - I{V2; Yi\U,Vi)- max[/(\/i; V2\U),I{W; V2\U)] and 
Di = I{Vi; Yi\U)-I{Vr, Y2\U, \/2) -max[/(\/i; ^ L/), /( 1/1/; Vi\U)] are achievable by treating chan- 
nels (S,D2) and (S,Di), respectively, as wiretap channels with side-information. The line EiFi 



corresponds to the sum rate bound given by (18). Finally, owing to convexity of the rate region, 
any point in the interior of the line EiFi is also achievable. Therefore, an achievable rate region for 
C3 is described by the pentagon OAiFiEiCi. 

If the confidentiality constraints ([T]) - ([2]) are relaxed, the channel C3 reduces to the channel 
Ci, whose rate region is described by (|3]) - ([5]). Further, in the absence of side-information, i.e., 



W = {(p}, the channel reduces to the classical two- user BC whose rate region is described by (29) 



(31). Lastly, if the encoder satisfies confidentiality constraints in the absence of side-information. 
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the channel C3 reduces to BC with two independent and confidential messages whose rate region 
was first characterized by Liu et. al [14]. It is described by the convex- hull of the set of all rate 
pairs {Ri,R2) that satisfy the following inequalities: 



3.5 Relation to past work 

For Class I channels, an inner bound was presented in [8j by extending Marton's achievability scheme 
for the classical two-user BC to include noncausal side-information at the encoder. In this paper, 
we employ Marton's technique and use results from the second moment method [22| to derive the 
inner bound which matches with the results presented in [8]. However, our method is simpler and 
generalizes well for obtaining inner bounds with other channel models, e.g., for channels of Class III 
considered in this paper. For the outer bound (specifically, for the sum-rate), we generalize the 
technique presented in [5j, to handle side-information at the encoder. When the side- information 
constraint is relaxed, our result reduces to the one presented for the classical two-user BC [5j. 



Class II channels were also addressed in |23], where an inner bound was derived by employing 

Marton's achievability scheme. An outer bound was also suggested in [23], but without a formal 
proof. In this paper, we derive an inner bound by generalizing the method suggested in [10] by 
incorporating noncausal side-information at the encoder. Our inner bound coincides with the one 
presented in [23], but once again the proof technique is much simpler. Furthermore, for the outer 
bounds, we explicitly address the problem of dealing with the two-dimensional rate region with a 
single auxiliary random variable. 

For Class III channels, we show that when the confidentiality constraints are relaxed, our achiev- 
able rate region reduces to region presented for the Class I channels, and hence to the one presented 
in [^. On the other hand, in the absence of side-information, our achievable region includes an 
explicit bound on the sum-rate for the two-user BC with confidentiality constraints (a model con- 
sidered in [14]). This further strengthens the generalization of our proof technique. 




(32) 




(33) 
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4 Proofs of achievability theorems 



In this section, we prove Theorem 3.1, Theorem 3.4 and Theorem 3.6 For any e > 0, we denote 
by A'i^\Px) an e-typical set comprising sequences picked from the distribution p{x). For ah the 
channel models, the encoder is given an e— typical sequence in a noncausal manner. 

4.1 Proof of Theorem l3J] 

For the channel Ci, generate 2'~^[^*+^*l independent typical sequences V((zt,j() G A^^\Pv^);t = 
1,2. Here, it G {1, . . . , 2^^'}; jt G {1, . . . , 2^-^^*}. Uniformly distribute 2^[^*+^t] sequences into 
2N_Rt i^jj^g^ QQ that each bin, indexed by it, comprises 2^^« sequences. To send the message pair 
(mi = ii, m2 = 22), the encoder at S looks for a pair (ji, 72) that satisfies the following joint typicality 
condition: Es = {(W, Vi(ii, ji), V2(i2, i2)) € a';^\Pw, Vi,V2)}- An error is declared at the encoder 
of S, if it is not possible to find the (ji,j2)— pair to satisfy the condition E^- The encoder error 
analysis can be found in Appendix A The channel input sequence is X G Ai^\Px\w .Vi ,V2) ■ 

At the destination D^, the decoder looks for {it,jt) that satisfies the following joint typicality 
condition: E^^ = {{\lt{it,jt),^t) £ ■^^€^\Pvt,Yt)} ■ An error is declared at decoder of D^, if it not 
possible to find a unique integer it to satisfy the condition From the union of events bound, 
the probability of decoder error at Dt can be upper bounded as follows: pf^^ < Vt{EI^^\Es) + 
Yliit^it P^(-^Dt l-E's)- From the asymptotic equipartition property (AEP) [24!, Ve > and suffi- 
ciently smah; and for large N, Vi{E^^\Es) < e. Further, for it / it, Pr(^Dj-Es) < 2"^[^(^*'^*)-^l. 
Therefore, we have pf^^ < e + 2^[^'+^t]2-N[^(^*'"^*)-'l, leading us to conclude that, for any eo > 
and sufficiently small; and for large N, P^^^ < eo if 

Rt + B:t<I{Vt;Yt). (34) 



For the channel Ci, the rate inequalities (34) and the bounds on the binning rates (65 ) - (67) (see 



Appendix [A|) are combined to obtain an achievable rate region given by ([3| - ([s]). This completes 



the proof of Theorem 3.1 



4.2 Proof of Theorem lOl 

For the channel C2, we consider the following two cases. 
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1. When Ri < R2: Generate 2'^(^2+fl*) typical sequences U(«, j) E A?^\Pu);i G {1, . . . , 2^^^}; 
j G {1, . . . , 2^^*}. Uniformly distribute these sequences into 2^^^^ bins, so that each bin 
comprises sequences. The bins are indexed by i. Define now the following mappings: 

G {!,..., 2^^*} ^ lnt{mt) £{0,...,2^^^ -l};t=l,2, 

where Int(a) denotes an integer to represent a. To transmit the message pair (mi, 7772), 
compute (int(mi) +Int(m2) mod 2^^^). By construction, the bin index 
i = Int^^ (int(mi) + Int(m2) mod Given the sequence W, the encoder looks for an 

integer j to satisfy the following joint typicality condition: 

{U{z,j),\N)eA'i'\Pw,u). 

Finally, X = f(U(i,j), W) is transmitted in N channel uses. 

At receiver Di, given /n2, the decoder looks for the pair [i = rrii,j) such that the following 
joint typicality condition is satisfied: 

En, ^ {(U(Int-i (Int(n7i) +Int(m2) mod 2^^^) , j), Yi) E A<i'\Pu ,y,)} ■ 

From AEP, it can be shown that Fr(E^_^) < 5i;\/6i > and sufficiently small; and for large N, 
if Ri + R* < I{U; Yi). Similarly, it can be shown that Pr(£'^^) < ^2; V(52 > and sufficiently 
small; and for large N, if i?2 + -R* ^ I{U]Y2). Additionally, by following a procedure similar 
to the one presented in Appendix [A| we bound the binning rate as follows: R* > I{U; W). 
Therefore, mi (resp. can be reliably decoded at Di (resp. D2) if 

Ri<I{U-Yi)-I{U;W), (35) 
R2<I{U;Y2)-IiU;W). (36) 



2. When R2 ^ Ri- By symmetry, we get the same rate bounds as in (35) and (36) 



This completes the proof of Theorem 3.4 
4.3 Proof of Theorem 13^6] 

For the channel C3, generate a typical sequence U G A^^\Pij), known to all nodes in the network. 
Generate 2^^^'*+^'^+^'^'^ independent typical sequences Vtik, jt,kt) e A?^\PvJ; H e {1, . . . , 2^^*}; 
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jt G {1, . . . , 2^^^*}; kte{l,..., 2^^*}. Uniformly distribute 2'^[^*+^*+^*] sequences into 2^^* bins, 
so that each bin, indexed by it, comprises 2^[^'+^'l sequences. Uniformly distribute 2'^1-^t"'"-^*] 
sequences into 2^^« sub-bins indexed by {it,jt), so that each sub-bin comprises 2^-^* sequences. 

To send the message pair (mi, m2), S employs a stochastic encoder. In the bin indexed by it, 
randomly pick a sub-bin indexed {it,jt)- The encoder then looks for a pair {ki,k2) that satisfies 
the following joint typicality condition: (W, ji, fci), \/2(i2, J2, ^2)) ^ A^e^\Pw,Vi,V2\u)- The 

channel input sequence X G Af^\Px\w,Vi,V2) transmitted in N uses of the channel. 

At the destination Dt, given U, the decoder picks kt that satisfies the following joint typicality 
condition: E^^ = {{\lt{it,jt,kt),'^t) ^ ■^^t^\Pvt.Yt\u)}- An error is declared at the decoder of Dj if it 
not possible to find an integer it satisfying E^^ . From union of events bound, the probability of de- 
coder error at can be upper bounded as follows: Pjf^^ < Pr(£'^jE's) + J2it^it X^jt kt ^^(P'^tl^s)- 
From AEP [23], Ve > and sufficiently small; and for large N, Pr{E^jEs) < e and for it 7^ it, we 
have Pr(EDj^s) < 2-N[^(^*;>'*|C^)-^l. Therefore, P^l < e + 2^i^^+<+^t]2-^[iiVt;n\u)-e] _ 
eo > and sufficiently small; and for large N, P^^^ < eo if 

Rt + R't + R*t <I{Vt;Yt\U). (37) 

The equivocation at the decoder of D2 is calculated by first considering the following lower bound: 
H{Mi\y^) > H{Mi\\^, U^, V^). Following the procedure in US Section V-B] and using the fact 
that Ml (U^, Vj^, V^) forms a Markov chain, we get 

^(Mi|Y^) >/f(Vf|UN)-/(Vf;V^|U^)-F(Vf|Mi,UN,V^,Y^)-/(Vf;Y^|UN,V^). (38) 



Now, Ve; > 0; Z = 4, . . . , 10 and sufficiently small; and for large N, the terms in (38) become 



if(Vf |U^) = N[i2i + R[ + i?*];/(Vf ; V^IU^) = N/(\/i; ^ty) +Ne4; 
F(Vf|Mi,uN,V^,Y^) < Ne5;/(Vf;Y^|UN,VN) t^I{Vr,Y2\U,V2) + Nee. (39) 



In (39), (a) follows from the codebook construction; (6) and (d) follow from standard techniques 
(for e.g., see [H, Lemma 3]); and (c) is proved in [14, Lemma 2]. A similar procedure is followed 
to calculate the equivocation at the decoder at Di. Finally, the security constraints ([T]) and ^ are 
satisfied by letting 

R'l = I{Vi;Y2\U,V2)-er,Rl = I{Vi-V2\U)-es; (40) 
R2 = I{V2;Yi\W,U,Vi)-eg;R*2 = I{Vv,V2\W,U)-eio. (41) 
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For the channel C3, rate inequahties (37), constraints (40) - (41) and bounds on the binning rates 
(68) - (70) (see Appendix [A|) are combined to obtain the rate region described by (16) - (18). This 
completes the proof of Theorem 3.6 



5 Proofs of converse theorems 



In this section, we prove Theorem 3.2, Theorem 3.3, Theorem 3.5, Theorem 3.7 and Theorem 3.8 



5.1 Proof of Theorem 1372] 

For the channel Ci, Ve > and sufficiently small; and for large N, Ri can be bounded as follows: 
NRi = i?(/Wi) = /(/Wi;Yf) + F(Mi|Yf) 

(a) ^ 

< /(/Wi; Yf ) + Ne ^[H{Y,,^\Y^-') - H{Yi,^\Y^-\ Mi)] + Ne 

n=l 

(c) N N 

< J^[//(yi,n) - Vi,n|Yr\ Ml)] +^€ = J2 HMuVr^; n,n) + Ne 

n=l n=l 



(d) 



Y,[IiMi,Yr\^n+i; Vi,n) - Vi,n|Mi, Y"-!)] +Ne 

n=l 
N 

Y,[HMi,yr\^n+i; Yi,n) - /(Yri;Tyn|Mi,WN^i)] +Ne 

n=l 
N 

^[/(Mi,Yri,WN^i; Yi,^) - I{M,,\N^^„Yl-';W^)] + Ne, 



n=l 

where (a) follows from Fano's inequality p3], (6) follows from the chain rule, (c) follows from the 
fact that conditioning reduces entropy, {d) follows from Csiszar's sum identity [25] and (e) is due 
to the fact that (Mi,W^_^i) is independent of 1%. We let Vi,n = (Mi, Wj^^^^, Y""^) and note that 
this choice satisfies the Markov chain requirement Vi — >• (X, W) — )• (Vi, Y2), specified in Section [3] 
for the channel Ci. Thus, we get 

N 

Ni?i <Y,HVi,n; Vi,n) - /(\/i,n; W^) + Ne. (42) 

n=l 

Proceeding in a similar manner and letting V2^n = {^2)^n+ij'^2~^)^ 

N 



Ni?2 < J^/(\/2,n; V2,n) " I{V2y, W^) + Ne. (43) 



n=l 
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5.2 Proof of Theorem Q 

For the channel Ci, Ve > and sufficiently small; and for large N, Ri can be bounded as 

Ni?i = H{Mi) = I{Mi;yf) + H{Mi\Y^) 
< /(Mi;Yf) + Ne, 



where (a) follows from Fano's inequality. Proceeding in a manner similar to the proof of Theorem 3.2 
(see Section[5l|, and letting Un = (W^+i, Y5'-^ Y^^+J and V/i,n = Mi. 

N 

Ni?l < J]l(t;n, \/l,n; Vi,n) " /(\/l,n; M/n|t^n) + Ne. (44) 
n=l 

Similarly, letting V2^n = M2, R2 can be upper bounded as follows: 

N 

Ni?2 < ^/(t^n, \/2,n; V2,n) " /(\/2,n; l/l/n|^n) + Ne. (45) 
n=l 

We next upper bound Ri + R2 as follows. Ve > and sufficiently small; and for large N, we have 

N(i?i + i?2) = H{Mi,M2) = H{Mi) + H{M2\Mi) 

= I{Mr,yf) + H{Mi\\f) + I{M2;y^\Mi) + H{M2\yt Ml) 

(a) 

< ^I(/Wi; n,n|Yri) + 5^/(M2; Vs.nlYs^i, Mi) + 2Ne, 

n=l n=l 

where (a) follows from Fano's inequality. Consider 

N N 

J]7(Mi;Yi,„|Yri) < j;/(Mi,Yri;Yi,n) 

n=l 

N N 

= /(Ml, Yr 1, Y^,+i; Yi,,) - ^ /(Y2V1; Yi,n| Ml, Yr 1) 

n=l n=l 
N 

= Y.iI{Mi,yi-\Y^^,^i,\N^^i; n,,) - Ii\N^^i; Vi,n| Mi, Y^ \ Y2V1)] 

n=l 
N 

- j;/(Y2Vi;n,„|Mi,Yri) 

n=l 
N 

^i:^ Y^[iiMi,yr'yln+i,K+i; n,n) - /(Mi; Yr\ Y2V1)] 

n=l 

N 

- E^(Y2Vi;n,n|Mi,Yri) (46) 



n=l n=l 

N 



n=l 
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Next consider 

N N 



n=l n=l 

N N 



= Y^I{Y--^; y2,n|Y2Vl, M^) + ^ /(M2; Ys.nl Y"" \ Y^Vl, ^l) 

n=l n=l 
N N 

^/(Y?-!; y2,n|Y^,+i, Ml) + ^/(M2, Wll'+i; y2,n|Yr\ Y2V1, Ml) 

n=l n=l 

N 

n=l 

N N 

5^/(Yri;V2,n|Y2Vi./Wi) + j;/(M2,Yr\Y2Vi,W^+i;y2,„|Mi) 

1=1 

N 

^/(M2;M/n|W::^+i,Yri,Y2Vi,/Wi) 



n=l n=l 

N 



n=l 

N N 



Y2,^\yl^_,„ Ml) + J^/(M2, Yr\ Y2^„+i, W^+i; V2,„|Mi) 

n=l 

N 

^/(M2; W^\\N^^„Y^,-\yl,^„Mi) (47) 



n=l n=l 

N 



n=l 

/N vn-1 vN 



where (6) and (c) follow from Csiszar's sum identity. With = (W^^^^^, Y°"\ Y^^^^^J; Vi^^ = Mi; 



and \/2,n = M2, from (46) and (47), we get 

N 

N(i?i + R2) < Y^i^iUn, Viy, yi,n) - I{Viy, W,,\U^)] 
n=l 

N 

+ Y,iHUn, V2,n; V2,n| \/l,n) " I{V2,n; Vi,^, U,,)] + 2Ne. (48) 

n=l 

Similarly, it can be shown that 

N 

N(i?l + R2) < Y.[I{Un, V2y, V2,n) " /(\/2,n; W^\U^)] 
n=l 

N 

+ ^[I(t;n, \/l,n; Vi,n| \/2,n) " /(\/l,n; V2,n, t^n)] + 2Ne. (49) 

n=l 

5.3 Proof of Theorem 1331 

For the channel C2, Ve > and sufficiently small; and for large N, Ri can be bounded as follows: 
NRi = H{Mi) = I{Mi;yf) + H{Mi\Y^) 
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(a) (fe) 

< I(Mi;Yf) + Ne < /(Mi; Yf , Ma) + Ne = /(Mi; Yf IM2) + Ne 

N 

^[//(yi,n|Yr\ M2) - //( Vi,n|YrS Ml, M2)] + Ne 

n=l 

< ^[/r(yi,„) - //(n,n|Yr\ Ml, M2)] + Ne 

n=l 
N 

= ^/(Mi,M2,Y5^-i;yi,„) + Ne 

n=l 

N 

= ^[/(Mi,M2, Yr\w::'+i; n.n) - /(W^_^i; yi,,|Mi, M2,Yr')] +Ne 

n=l 
N 

Y^[IiMi,M2,Yr\K-,i; n,n) - /(Mi; U/n|M2,Yri,W^_^J] +N6 

n=l 
N 

'^^ 5^[/(Mi, M2, W^+i; n,n) - /(Ml, M2, Wj;^^i; l/l/n|Y^i)] + Ne 

n=l 
(9) ^ 

< ^[/(Mi,M2,Wj;Vi;'>'i,n)-/(Mi,M2,Wj:'+i;l/l/n) + //(Mi,M2,Wj;'+i)]+Ne. (50) 

n=l 

where (a) follows from Fano's inequality; (6) follows from the data-processing inequality; (c) follows 
from chain rule; (d) follows from the fact that conditioning reduces entropy; (e) follows from Csiszar's 
sum identity; (/) is due to the memoryless nature of the channel; and {g) is obtained after simple 
calculations. We let Un — (Mi, M2, Wj^^^^) and note that this choice satisfies the Markov chain 
requirement U — )• (X, W) — t- (Vi, V2) specified in Section [3] for the channel C2 to get 

N 

N/?l < Y.[I{Un; n,n) - I{Un; Wn) + H{Un)] + Ne. (51) 
n=l 

By symmetry, we get the following bound on R2. 

N 

N/22 < J2^I{Un; Y2,n) " I{Un; Wn) + H{Un)\ + Ne. (52) 
n=l 

We note that the factor H{Un) is independent of the distribution characterizing the channel C2. 
5.4 Proof of Theorem 13.71 

For the channel C3, Ve > and sufficiently small; and for large N, Ri can be bounded as follows: 
NRi = //(Ml) = /(Mi;Yf) + //(Mi|Yf) 
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(a) (b) 

< /(/Wi;Yf)+Ne < /(/Wi; Yf ) - /(Mi; Y^) + 2Ne 

N 

n=l 
N 

^^[/(Mi, Y^i; n,n|Y^|„+i) - /(Ml, Yj^„^.i; Va.nlYr^)] + 2N6 

n=l 
N 

5^[/(Mi; n,n|Yj^,+i, Y^i) - /(Mi; y2,n|Y^|„+i, Y^ ^)] + 2N6 

n=l 
N 

< J][/(Mi, l/l/„; yi,„|Yj^,+i,Yri) - /(Mi; V2,n|Y^|„+i, Y^-i)] + 2Ne 

n=l 
N 

^[/(Mi;yi,„|Yj^„+i,Yr^) + /(l/l/„;yi,„|Mi,Y^|„+„Yri) 

n=l 

-/(Mi;y2,n|Y^^„+i,Yri)] + 2Ne 

N 

= J][/(Mi;yi,„|Y^^„+i,Yri) + //(M4|Mi,Yj|„+i,Yri) 

n=l 

-//(l/l/„,|Mi, yi,„, Y^|„+i, Y^i) - /(Mi; y2,„|Yj^„+i, Y^i)] + 2Ne 

N 

< ^[/(Mi;yi,„|YN^+i,Yri) + //(M4|Mi,YN„+i,Yri) 

n=l 

-/(Mi;y2,„|Y^^^+i,Yri)] + 2Ne, 

where (a) is from Fano's inequality, (6) is from confidentiality constraints, (c) and (d) follow from 
Csiszar's sum identity and (e) is the chain rule for mutual information. Letting Un — (Yi^,„^i, Y2^^); 
and Ui^i = • • • = = Mi, where U and Vi satisfy the Markov chain L/ — t- Vi — t- X specified in 
Section [3] for the channel C3 , we get 

N 

N/?l < J2^I{V,^n;Yi,n\Un) + H{Wn\Un,Vi,n)-I{Vl,n;Y2,n\Un)]+2Ne. (53) 
n=l 

Proceeding in a similar fashion and letting V2^i = ■ ■ ■ = = M2, 

N 

N/?2 < J2^I{V2,n;Y2,n\Un) + H{Wn\Un,V2,n)-I{V2,n;Yi^n\Un)]+21^e. (54) 

n=l 

For the channel C3, we also derive a genie-aided outer bound by letting a hypothetical genie 
give Di message M2, while D2 computes the equivocation using M2 as side-information. Ve > and 
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sufficiently small; and for large N, Ri can be upper bounded as follows: 



Ni?i = F(/Wi) <i/(Mi|Y^) + Ne<-H'(Mi,M2|Y^) + Ne 

= H{Mi\Y^, M2) + H{M2\Y^) + Ne < H{Mi\Y^, M2) + Ne 

(a) 

< H{Mi\y^ , M2) - H{Mi\Yf) + Ne < H{Mi\y^ , M2) - H{Mi\Yf , M2) +^6 

< /(Mi;Yf|M2)-/(/Wi;Y^|/W2) + 2Ne 

N 

= n,n|Y^|„+i, M2) - I{Mi; V2,„|Yr\ M2)] + 2Ne 

n=l 
N 

^[/(Mi, Y^-i; yi,„|Yj^„+i, M2) - /(Ml, Y^|„+i; y2,n|Yr\ M2)] + 2N6 

n=l 
N 

^[/(Mi; n,n|Yj^„+i, Yr\ M2) - /(Mi; V2,„|YJ^„_^i, Y"" \ M2)] + 2Ne 

n=l 
N 

< J][/(Mi, l4/„; yi,„|Y^;„+„Yr\M2) - /(Mi; y2,n|Yj|„+i, Y^i, M2)] + 2Ne 

n=l 
N 

= J][/(Mi;yi,„|Yj|„+i,Yr\M2) + /(!/!/„; yi,n|Mi,Yj|„+i,Yri,M2) 

n=l 

-/(Mi; y2,n|Yj^,_,i, Yr\ /W2)] + 2Ne 

N 

= ^[/(Mi;yi,„|Y^|„+i,Yr\M2) + //(l/l/n|Mi,yi:^i,Yr\M2) 

n=l 

-//( 1/141 Ml, yi,„,Yj^„+i,Y2"-',/W2) - /(Mi; y2,„|Y^^„+i, Y^ \ M2)] + 2Ne 

N 

< ^[/(Mi;yi,„|Y^|„+i,Yr\M2) + //(l/l/n|Mi,Yj^„^i,Yr\M2) 

n=l 

-/(Mi; y2,„|Yj^„+i, Yr\ M2)] + 2Ne, 

where (a) follows since the genie gives Di message M2, (b) and (c) follow from Csiszar's sum identity. 
Letting Un = (Yj^„+i, Y^-i), V,,i = ■ ■ ■ = \/i,n = Mi and ^,1 = • • • = V2,n = M2, where U, and 
\/2 satisfy the Markov chains L/ — t- Ui — t- X and (7 — )• \/2 — t- X specified in Section [3] for the channel 
C3, Ri can be bounded as 

N 

N/?l < J^[/(\/l,n; yi,„|t^n, V2,n)+H{Wn\Un, Vi,n, V2,n) - I {Vl^n, Y2,n\Un, Us,^)] + 2Ne. (55) 
n=l 

Similarly, 

N 

N/2l < Y,[I{V2,n; Y2,n\Un, V,,n) + H{Wn\Un, ^.n) " /( \/2,n; n,n|^n, \/l,n)] + 2Ne. (56) 

?i=l 
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For the channel C3, the outer bound on Ri +R2 can be made tighter by the foUowing procedure. 



From (19) - (20), we see that 



Therefore, 



Ri + R2< h+h, 
Ri + R2< 1*1 + II- 

Ri+R2< min[Ii + I^h + II]. 



(57) 
(58) 



(59) 



We show now that the bound (59) is a tighter bound than (57) and (58). It is easy to see that 



Ii+l2 = 1*1 + I2 + HW; Vi\U, V2) + liW; V2\U, Vi). 

Consider 2(/i + h) = 2[/J + /| + I{W] Vi\U, V2) + I{W; V2\U, Vi)], which imphes the following: 

min[/i+/2*,/2 + /i*] < h+h, 
mm[h+l2,h + I*i] < 1*1+1*2- 



Therefore, the sum rate bound given by (59) is tighter than (57) and (58) 



5.5 Proof of Theorem 13:8] 

For the channel C3, Ve > and sufficiently small; and for large N, Ri can be bounded as follows: 



Ni?i = H{Mi) = I{Mi;Y^) + H{Mi\Yl 

(a) (fe) 

< /(Mi;Yf) + Ne < /(Mi; Yf ) - I(/Wi; Y^) + 2Ne, 

where (a) follows from Fano's inequality; and (6) follows from confidentiality constraints. Following 
the procedure used to prove Theorem p^S^ (see Section O and letting = (W^^^, Y5'"\ Y^^+J 
and \/i,n = Ml, 

N 

Ni?i < Y^HUr,, \/i,„; yi,n) - /(\/i,n; H/nlL'n) " I{Viy, Va.n) + 2Ne. (60) 

n=l 

Similarly, letting V2^ri = M2, we get 

N 



Ni?2 < ^/(tVn, \/2,n; V2,n) " /(^.n; Wr,\U,,) - I{V2y, ^.n) + 2Ne, 



(61) 



n=l 
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and the following bounds on the sum-rate Ri + R2- 

N 

N(i?l + R2) < Y^lHUn, \/l,n; n,n) " I{Viy, W^\U,, 



n=l 



+ ^[IiU^, V2,n; V2,n| \/l,n) " HV^^n, U^)] " /(\/l,n; V2,„) + 2Ne, (62) 

n=l 

N 

N(fll + R2) < J2[I{Un, V2,n; Y2,n) " I{V2,n; Wn\Un)] 
n=l 

N 

+ J2[HUn, \/l,n; n,n| \/2,n) " HVi^n, V2,n, U^)] " /(^.n; ^.n) + 2Ne. (63) 

n=l 

A time sharing RV Q, which is uniformly distributed over N symbols and independent of the 
RVs Ml, M2, W, U, Vi, V2, X, Yi and Y2 is introduced for the single letter characterization of the 
above derived outer bounds. Applying the procedure similar to the one presented in [24, Chapter 
15.3.4] on the N-letter expressions obtained in the above stated theorems, we get the outer bounds 
presented in Section [3} This completes the proofs of Theorem 3.2, Theorem 3.3, Theorem 3.5 
Theorem 13.71 and Theorem 13. 8[ 



6 Conclusions 

We presented inner and outer bounds on the capacity region of three classes of two-user discrete 
memoryless broadcast channels, with noncausal side-information at the encoder. We generalized 
existing approaches to prove the achievability theorems, and characterized the rate penalties for 
having to deal with side-information at the encoder. For channels with confidentiality constraints, 
we showed that rate penalties exist for dealing with both side-information and confidentiality con- 
straints. In the case of outer bounds, we focus on the explicit characterization of the sum-rate 
bounds. For channels where each receiver has a priori knowledge of the message of the other re- 
ceiver, we showed that the outer bounds are only a factor away from the achievable region, where 
the factor is independent of the channel distribution. 



A Encoder error analysis 

Here, we upper bound the probability of encoder error for the channel Ci, by using results from the 
second moment method [22j. This method was also employed in [26J and [27, Chap. 7, pp. 354] to 
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provide an alternative proof of Marten's achievability scheme. An error is declared at the encoder of 
S if it is not possible to find a pair (11,12) to satisfy the condition Es = {(W, ji), \/2(i25 i2)) G 

Vi,V2)}- Let Pe,Es denote the probability of error at the encoder, i.e., Pe,Es = Pi'(-^s)- 
Let / be an indicator RV that the event £"3 has occurred. Let Q = I; Q = IE[(?]; and 

Var[Q] = E[(Q — Q)^], where E(.) denotes the expectation operator. Pe,Es can be upper bounded 
as follows: 

Pe,Es = Pr((? = 0) < Yav[Q]/Q^, (64) 

where (i) follows from Markov's inequality for non-negative RVs. Consider now 

Q ^ > ^(1 _5(n))2-n[^(Vi;V2)+^(\/i,^2;M/)+4e] 

ji ,h ji J2 

= (1 _ ^(N)-j2-N[/?^+/?5-/(\/i;\/2)-/(\/i,\/2;l4/)-4e]_ 



Next, consider Var[Q] = E,„,2 E,i,,^{E[/(ji,i2)/(ii,i^)] - j2)]E/(il, j^)]}. We have the 

following four cases: 

1. If 7^ ji and j2 7^ j2, then /(ji, ^'2) and I{j'i,j2) are independent and Var[Q] = 0. 

2. If j[ = h and f, = J2, then E[l {h, j2)l M = IE[/(ii, J2)] < 2'''WV^;V,HliV,,Vr,W)-^e] _ 

3. lij[^h and = J2, thenE[/(ji,i2)/(jl,J^)] < 2-N[/{\/i;V2| W(v„\/2;i4/)+/(v,;U2,vi/)-6e], 

4. Uj[=h and / J2, thenE[/(ji,i2)/(jl,j^)] < 2-N[/{\/i;V2|f/)+/(v.,V2;W/)+/(V2;U„w)-6e]_ 



Substituting for Q and Var[Q] in (64), we can show that P{Es) < 5^^^ V^g^ > and sufficiently 



small; and for N large, if the following conditions are simultaneously satisfied: 

R[ > I{W;Vi)-ei, (65) 
4 > I{W;V2)-e2, (66) 
+ 4 > /(\/i;\/2)+/(\/i,\/2;l/l/)-e3. (67) 

Similar analysis results in a bound on the binning rates for the channel C3. The probability 
of encoder error P{Es) < ^q^J , ^^'cj > and sufficiently small; and for N large, if the following 
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conditions are simultaneously satisfied: 

Rl > I{W;Vi\U)-eu, (68) 
Rl > I{W;V2\U)-ei2, (69) 
Rl + Rl > I{Vi;V2\U) + IiVi,V2;W\U)-ei3. (70) 
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Figure 1: State-dependent broadcast channels with side- information at the transmitter: (a) Class I; 
(b) Class II; and (c) Class III. 
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Figure 2: Pictorial representation of the rate region for Class I channels. 
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Figure 3: Pictorial representation of the rate region for Class III channels. 
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